Resource management for extreme scale high performance computing systems in the presence of failures

2018 Summer.Includes bibliographical references.High performance computing (HPC) systems, such as data centers and supercomputers, coordinate the execution of large-scale computation of applications over tens or hundreds of thousands of multicore processors. Unfortunately, as the size of HPC systems continues to grow towards exascale complexities, these systems experience an exponential growth in the number of failures occurring in the system. These failures reduce performance and increase energy use, reducing the efficiency and effectiveness of emerging extreme-scale HPC systems. Applications executing in parallel on individual multicore processors also suffer from decreased performance and increased energy use as a result of applications being forced to share resources, in particular, the contention from multiple application threads sharing the last-level cache causes performance degradation. These challenges make it increasingly important to characterize and optimize the performance and behavior of applications that execute in these systems. To address these challenges, in this dissertation we propose a framework for intelligently characterizing and managing extreme-scale HPC system resources. We devise various techniques to mitigate the negative effects of failures and resource contention in HPC systems. In particular, we develop new HPC resource management techniques for intelligently utilizing system resources through the (a) optimal scheduling of applications to HPC nodes and (b) the optimal configuration of fault resilience protocols. These resource management techniques employ information obtained from historical analysis as well as theoretical and machine learning methods for predictions. We use these data to characterize system performance, energy use, and application behavior when operating under the uncertainty of performance degradation from both system failures and resource contention. We investigate how to better characterize and model the negative effects from system failures as well as application co-location on large-scale HPC computing systems. Our analysis of application and system behavior also investigates: the interrelated effects of network usage of applications and fault resilience protocols; checkpoint interval selection and its sensitivity to system parameters for various checkpoint-based fault resilience protocols; and performance comparisons of various promising strategies for fault resilience in exascale-sized systems

Biogeochemical relationships between ultrafiltered dissolved organic matter and picoplankton activity in the Eastern Mediterranean Sea

Author Posting. © The Author(s), 2009. This is the author's version of the work. It is posted here by permission of Elsevier B.V. for personal use, not for redistribution. The definitive version was published in Deep Sea Research Part II: Topical Studies in Oceanography 57 (2010): 1460-1477, doi:10.1016/j.dsr2.2010.02.015.We targeted the warm, subsurface waters of the Eastern Mediterranean Sea (EMS) to investigate processes that are linked to the chemical composition and cycling of dissolved organic carbon (DOC) in seawater. The apparent respiration of semi-labile DOC accounted for 27 ± 18% of oxygen consumption in EMS mesopelagic and bathypelagic waters; this value is higher than that observed in the bathypelagic open ocean, so the chemical signals that accompany remineralization of DOC may thus be more pronounced in this region. Ultrafiltered dissolved organic matter (UDOM) collected from four deep basins at depths ranging from 2 to 4350 m exhibited bulk chemical (1H-NMR) and molecular level (amino acid and monosaccharide) abundances, composition, and spatial distribution that were similar to previous reports, except for a sample collected in the deep waters of the N. Aegean Sea that had been isolated for over a decade. The amino acid component of UDOM was tightly correlated with apparent oxygen utilization and prokaryotic activity, indicating its relationship with remineralization processes that occur over a large range of timescales. Principal component analyses of relative mole percentages of monomers revealed that oxygen consumption and prokaryotic activity were correlated with variability in amino acid distributions but not well correlated with monosaccharide distributions. Taken together, this study elucidates key relationships between the chemical composition of DOM and heterotrophic metabolism.TBM and AG acknowledge funding from the Hellenic GSRT/European Union (non-EU Grant No180) and SESAME Project (European Commission's Sixth Framework Program, EC Contract No GOCE-036949). TY was supported by the Japanese Society for the Promotion of Science (JSPS) Postdoctoral Fellowship for research abroad and DDC received a fellowship of the University of Groningen. Microbial laboratory work and molecular analyses were supported by a grant of the Earth and Life Science Division of the Dutch Science Foundation (ARCHIMEDES project, 835.20.023) to GJH. DJR and TBM were supported by grants from the Gordon and Betty Moore Foundation and from the C-MORE organization of NSF

ECMO for COVID-19 patients in Europe and Israel

Since March 15th, 2020, 177 centres from Europe and Israel have joined the study, routinely reporting on the ECMO support they provide to COVID-19 patients. The mean annual number of cases treated with ECMO in the participating centres before the pandemic (2019) was 55. The number of COVID-19 patients has increased rapidly each week reaching 1531 treated patients as of September 14th. The greatest number of cases has been reported from France (n = 385), UK (n = 193), Germany (n = 176), Spain (n = 166), and Italy (n = 136) .The mean age of treated patients was 52.6 years (range 16–80), 79% were male. The ECMO configuration used was VV in 91% of cases, VA in 5% and other in 4%. The mean PaO2 before ECMO implantation was 65 mmHg. The mean duration of ECMO support thus far has been 18 days and the mean ICU length of stay of these patients was 33 days. As of the 14th September, overall 841 patients have been weaned from ECMO support, 601 died during ECMO support, 71 died after withdrawal of ECMO, 79 are still receiving ECMO support and for 10 patients status n.a. . Our preliminary data suggest that patients placed on ECMO with severe refractory respiratory or cardiac failure secondary to COVID-19 have a reasonable (55%) chance of survival. Further extensive data analysis is expected to provide invaluable information on the demographics, severity of illness, indications and different ECMO management strategies in these patients

Tyloses and Phenolic Deposits in Xylem Vessels Impede Water Transport in Low-Lignin Transgenic Poplars: A Study by Cryo-Fluorescence Microscopy1[W][OA]

Of 14 transgenic poplar genotypes (Populus tremula × Populus alba) with antisense 4-coumarate:coenzyme A ligase that were grown in the field for 2 years, five that had substantial lignin reductions also had greatly reduced xylem-specific conductivity compared with that of control trees and those transgenic events with small reductions in lignin. For the two events with the lowest xylem lignin contents (greater than 40% reduction), we used light microscopy methods and acid fuchsin dye ascent studies to clarify what caused their reduced transport efficiency. A novel protocol involving dye stabilization and cryo-fluorescence microscopy enabled us to visualize the dye at the cellular level and to identify water-conducting pathways in the xylem. Cryo-fixed branch segments were planed in the frozen state on a sliding cryo-microtome and observed with an epifluorescence microscope equipped with a cryo-stage. We could then distinguish clearly between phenolic-occluded vessels, conductive (stain-filled) vessels, and nonconductive (water- or gas-filled) vessels. Low-lignin trees contained areas of nonconductive, brown xylem with patches of collapsed cells and patches of noncollapsed cells filled with phenolics. In contrast, phenolics and nonconductive vessels were rarely observed in normal colored wood of the low-lignin events. The results of cryo-fluorescence light microscopy were supported by observations with a confocal microscope after freeze drying of cryo-planed samples. Moreover, after extraction of the phenolics, confocal microscopy revealed that many of the vessels in the nonconductive xylem were blocked with tyloses. We conclude that reduced transport efficiency of the transgenic low-lignin xylem was largely caused by blockages from tyloses and phenolic deposits within vessels rather than by xylem collapse